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Abstract 

We propos^] a theoretical development of the model-free control in order 
to extend its robustness capabilities. The proposed method is based on 
the auto-tuning of the model-free controller parameter using an optimal 
approach. Some examples are discussed to illustrate our approach. 



1 This work is distributed under CC license http://creativecommons.org/licenses/ 
by-nc-sa/3.0/| 



1 Introduction 



The model-free control methodology, originally proposed by [T] , has been widely suc- 
cessfully applied to many mechanical and electrical processes. The model-free control 
provides good performances in disturbances rejection and an efficient robustness to 
the process internal changes. To improve the efficiency of the model-free control, 
we propose to use the variational optimization principle in order to tune on-line the 
model-free control parameter a. 

The proposed approach considers the model-free control law as a cost criterion 
which could be minimized relating to the parameter a. To minimize the cost criteria, 
the variational calculus is used considering properties of the symplectic geometry. In 
particular, it has been shown that the integration of a cost criteria under symplectic 
geometry assumptions provides very simple integration algorithms that can preserve 
physical properties of the integrated system and good convergence properties. More- 
over, simplicity of this kind of integrator allows building an on-line optimization 
process that can adjust the a parameter according to the controlled process dynamic. 

The paper is structured as follows. Section II presents an overview of the model- 
free control methodology including its advantages in comparison with classical method- 
ologies. Section III discusses the application of the calculus of variations to the 
model-free control. Some concluding remarks may be found in Section IV. 

2 Model-free control: a brief overview 

2.1 General principles 
2.1.1 The ultra-local model 

We only assume that the plant behavior is well approximated in its operational range 
by a system of ordinary differential equations, which might be highly nonlinear and 
time-varyingQ The system, which is SISO, may be therefore described by the input- 
output equation 



• u and y are the input and output variables, 

• E, which might be unknown, is assumed to be a sufficiently smooth function of 
its arguments. 

*See [HE] for further details. 





where 



I 



Assume that for some integer n, < n < l, ^||y ^ 0. From the implicit function 
theorem we may write locally 

y <"> = <S(t, y,y,..., y^, y ( " +1) , y« u, u, . . . , «W) 

By setting (£ = F + a« we obtain the ultra-local model. 

Definition 2.1 fl}/ If u and y are respectively the variables of input and output of a 
system to be controlled, then this system admits the ultra-local model defined by: 

y W = F + au (2) 

where 

• a G R is a non-physical constant parameter, such that F and au are of the 
same magnitude; 

• the numerical value of F , which contains the whole "structural information" , is 
determined thanks to the knowledge ofu, a, and of the estimate of the derivative 

y{n) _ 

In all the numerous known examples it was possible to set n = 1 or 2. 
2.1.2 Numerical value of a 

Let us emphasize that one only needs to give an approximate numerical value to a. 
It would be meaningless to refer to a precise value of this parameter. 

2.2 Intelligent PI controllers 
2.2.1 Generalities 

Definition 2.2 [1] If n = 1, we close the loop via the intelligent PI controller, or 
i-PI controller, 

u = -- + V - + C(e) (3) 
a a 

where 

• y* is the output reference trajectory, which is determined via the rules of flatness- 
based control (J3i \$); 

• e = y* — y is the tracking error; 

• C(e) is of the form KpE + Kj J e. Kp, Kj are the usual tuning gains. 

Equation is called model-free control law or model-free law. 

The i-PI controller [3] is compensating the poorly known term F. Controlling the 
system therefore boils down to the control of a precise and elementary pure integrator. 
The tuning of the gains Kp and Kj becomes therefore quite straightforward. 
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2.2.2 Classic controllers 

See [3J for a comparison with classic PI controllers. 



2.2.3 Applications 

See [HI [7J El El HOI EH [El H3] for already existing applications in various domains. 

2.3 Numerical differentiation of noisy signals 

Numerical differentiation, which is a classic field of investigation in engineering and 
in applied mathematics, is a key ingredient for implementing the feedback loop |3j 
Our solution has already played an important role in model-based nonlinear control 
and in signal processing (see [H] for further details and related references). 

The estimate of the I s * order derivative of a noisy signal y reads (see, e.g., [13] ) 



This window 



y = — 7^ J Q (T — 2t)y(t)dt where [0,T] is a quite "short" time window, 

is sliding in order to get this estimate at each time instant. 

Denoising of y leads to the estimate y = ^ L (2T — 3t)y(t)dt 

The above results are the basis of our estimation techniques. Important theoretical 

developments, which are of utmost importance for the computer implementation, may 

be found in [TB]. We establish the following hypothesis: 

Hypothesis 2.1 fJJ/ The estimate of the derivative is realized with an high bandwidth 
and is not biased; in particular compared to the noise. 

2.4 A first academic example: a stable monovariable linear 
system 

Introduce as in [U [2] the stable transfer function 

(* + 2) 2 



(4) 



2.4.1 A classic PID controller 



We apply the well known method due to Broida (see, e.g., [UJ) by approximating 
System [4] via the following delay system 



Ke 



(Ts + 1) 



^It implies in other words that we obtain real-time techniques. 
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K = 4, T = 2.018, r = 0.2424 are obtained thanks to graphical techniques. The 
gain of the PID controller are then deduced [17] : K P = ^^okt^ = 1.8181, Kj = 
j^p = 0.7754, K D = Qjf = 0.1766. 



2.4.2 i-PI. 

We are employing y = F + u and the i-PI controller 

u=-[F] e + y* + C(e) 

where 

• l F ]e = [y]e - U, 

• y* is a reference trajectory, 

• £ = y* -y, 

• C(e) is an usual PI controller. 



2.4.3 Numerical simulations 

Figure 1(a) shows that the i-PI controller behaves only slightly better than the classic 
PID controller (Fig. 1(b)). When taking into account on the other hand the age- 
ing process and some fault accommodation there is a dramatic change of situation: 
Figure 1(c) indicates a clear cut superiority of our i-PI controller if the ageing pro- 
cess corresponds to a shift of the pole from 1 to 1.5, and if the previous graphical 
identification is not repeated (Fig. 1(d)). 



2.4.4 Some consequences 

• It might be useless to introduce delay systems of the type 

T(s)e- Ls , T G R(s), L > (5) 

for tuning classic PID controllers, as often done today in spite of the quite 
involved identification procedure. 

• This example demonstrates also that the usual mathematical criteria for robust 
control become to a large irrelevant. 

• As also shown by this example some fault accommodation may also be achieved 
without having recourse to a general theory of diagnosis. 
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2 4 G 8 10 12 14 16 o 5 10 15 

Time (s) Time (t) 

(a) i-PI control (b) PID control 




2 4 6 8 10 12 14 1G 5 10 15 

Time (s) Time (s) 



(c) i-PI control (d) PID control 

Figure 1: Stable linear monovariable system (Output (-); reference (- -); denoised 
output (. .)). 

2.5 From the analytical mechanics to the model-free control 

The concept of symplecticity, described very largely by [TS] gives a rigorous math- 
ematical framework to the variational problems including the concept of symmetry. 
Lagrangian mechanics besides is completely formalized thanks to variational calcula- 
tion within the framework of the symplectic spaces properties. It introduces, for the 
mechanical systems, the concept of Hamiltonian and the generalized coordinates p and 
q (resp. proportional to the position and the acceleration), which using the Euler- 
Lagrange equation and the Hamilton- Jacobi equation, allows to retrieve the basic 
principle of dynamics. Thus, in the case of a conservative mechanical system inde- 
pendent of time, the Hamiltonian energy is preserved and induces the conservation of 
certain properties in symplectic spaces [19J. Although the symplecticity is a relatively 
abstract concept, much of the works (let us quote e.g. HH HU EEJ E21 E31 121 ES]) 
established the possibility of using symplectic integration algorithms under certain 
conditions i.e able to preserve the Lagrangian structure of the mechanical systems, 
and to preserve the Hamiltonian in particular in the case of the systems that are 
independent of time. 
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3 Introduction to the variational model-free con- 
trol 



3.1 Possibility of controlling a 

The fundamental goal of a variational optimization of the model-free control law ^ 
is to increase the robustness/the tracking of the reference by an online adjustment of 
the parameter a. Starting from the definition of a cost criterion, we justify the use 
of variational methods by the fact that they allow to calculate the parameter a as a 
solution of the optimization problem according to the time. 

Considered application Consider an application in power electronics [33] where 
we have to control the output voltage of a power converter according to an output 
reference. Consider the dc/dc buck converter (Fig. [2j where u is the duty-cycle and 
E = 20V L = 1 niH, C — 10 /xF. The load is a simple varying resistor R. 




Figure 2: Classical buck converter. 



u is the input of the converter to control. The controlled output voltage is noted y and 
the output reference voltage is noted y*. The equivalent transfer function H = y/u 
of this buck converter to control is of the second order and is stable. 



3.2 Discrete model-free control law and associated properties 



In practice, when the implementation of a i-PI controller is carried out in a digital 
way like a micro-controller or FPGA for example, it is necessary to discretize the i-PI 



controller of the def. (2.2). 



u k = -±(F k ^-yM*\ k )+C(e)\ k = -l 



\ 



yW\ k ^-au^-y^X 

V v ' 

Fk-i , 



+ C(e)l (6) 



' - [y (n) \k-i ~ y [n) i/, 



+ C(e) 



(7) 
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Definition 3.1 For any discrete moment tk, k G N, one defines the discrete con- 
troller i-PI. 

1 



)+C(s)\ k (8) 



where 

• y* is the output reference trajectory; 

• e = y* — y is the tracking error; 

• C is a usual corrector PI where Kp, Kj are the usual tuning gains. 

The discrete intelligent controller is also called discrete model-free control law or 
discrete model-free law. 

Theorem 3.1 [26] If the function f(x,t) in the equation x = f(x,t) is continuous 
in t and if it exists a positive constant I such that: 

\\f(x 2 ,t)- f(x 1 ,t)\\<l\\x 2 -x 1 \\ (9) 

for all x\ and x 2 in the neighborhood B r of the origin, and for all t 6 [to, to + T],T 6 
E +J then the differential equation has a single solution x{t) for sufficiently small initial 
states and a sufficiently short time period T . The condition is called Lipschitz 



condition and the constant I is the Lipschitz constant. If is satisfied, one says that 
f is locally Lipschitz. 

The example presented Fig. [4] shows, in the case of a variable reference with a 
load disturbance, which occurs at (t = 0,003 s), and a simple corrector gain K p , the 
existing difference between a model-free control law with a constant and a dependent 
on the time. 

Hypothesis 3.1 The output reference voltage is K y * -Lipschitz and varies slowly ac- 
cording to the time. 



The hyp. |3.1| implies that u and thus y and e are Lipschitz if the model-free 
control law is stable. In the same manner, it is appropriate to limit the variations on 
the possible drifts of the model H. 

Hypothesis 3.2 The drifts of the H parameters are Lipschitz. 

In previous model-free control applications (e.g. [13]), the static value of a does 
not influence significantly the stability of the model-free control. However, when a 
varies, it proves that it is possible to act on the performances of the model-free control 
by adjusting on-line the a parameter. The objective is thus to be able to define a 
variation law of a such that the dynamic performances of the model-free control are 
improved. 
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3.2.1 Model-free control v-K a degenerated 



In order to assume correctly the variations of a within the discrete model-free law 
(|8]) and with an aim of satisfying the integration conditions of the Euler-Lagrange 
equation, which will allow the a-optimization of the model-free law, it is advisable to 
define the dynamic of a. Consequently, we consider the addition of the a derivative 



Definition 3.2 When the system works in closed-loop, one defines the Uk-degenerate 
model-free law for n = 1 such that: 



u k = Uk-x - 7 



(dy 




dy c 


\dt 


fc-i 


dt 



(10) 



where 7 = 1/a u , K a e M* and v e N that define the dynamics of variation of a. 



The parameter a verifies the def. 2.1 



The model-free law (10) seems to be a redefinition of the original concept (2.2) 



taking into account the variations of the parameter a. 
3.2.2 Model-free local control law Ufc-implicite 

We establish a non-recursive expression and implicitly dependant on F . According 



to the def. 2.2, and under the hyp. 2.1, we have in the discrete time: 

'd7^ 



1 U dy c 



dt 



that can be rewritten: 



a u u k = -F k _i + 
oT v u k + = 



dye 
dt 

dye 
dt 



+ a 



+ a' v { K, 



d7 
dt 

d r y\ v 
~dt 



+ C(s)\ k 

ar v C(e)\ h 
+ or"C{e)\ h 



(12) 
(13) 



According to the th. 3.1, we call, Mfc-implicite model-free discrete law, the following 
expression: 



dy 

F k ^ 1 +a~ v u k - 1 



dye 
dt 



a u C(e)\, + a' 



d7 
dT 



(14) 



fe-i 



■^One may consider, in future work, higher derivative order of a 



— output voltage V 
ref. output V 



0.001 0.002 0.003 0.004 0.005 0.006 007 0.008 0.009 01 

time (s) 



I I I I I I I 






— / I I I 


I I I I 



0.001 0.002 0.003 0.004 0.005 0.006 007 0.008 0.009 01 

time (s) 

(a) a = 14, K p = 2 



a a A A A A r 
' ^ v \j \j 



output voltage V 
ref. output V 
1 II II II 




0001 0.002 0003 0.004 0.005 0.006 0.007 0.008 0.009 0.01 

time (s) 




A I 



0001 0.002 0003 0.004 0.005 0.006 0.007 0.008 0.009 0.01 

time (s) 

(b) a{t) = 14 + 10 6 1, K p = 2 
Figure 3: Comparison between a constant and a variable. 
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ds 
dt 



a~ v C(e)\ + a 



fc-i 



dt 



(15) 



Let us define 4f = 4r I , . 

dt dt I k — 1 



^| like the derivative of the tracking error using the 



th. 3^ via the hyp. |3.2 



When the corrector C is defined by a single constant gain C = K p , then it exists 
a linear relation between a and the output and its derivative. It comes then: 



Definition 3.3 The model-free Lagrangian verifies: 



with 7 



7 



d£ 

dT 



+ K a 

fe-i 
K a G M 



d7 
dt 



(16) 



i/GN 



In this expression, the parameters i£p and K a are constants. Since the variable to 
find is 7, e and ^ are considered as constants over a small time. 



3.3 Model-free Lagrangian 
3.3.1 Criterion L a 

Based on the z/--ff Q -degenerated expression, we define the variational model-free cri- 
terion L a such that: 

The expression ^-i^-degenerated provides a "direct equivalence relation" between 
the traditional expression of the reference tracking y — y* and the model-free control. 
The correction gain K p is here a scaling factor. 



3.3.2 Elements of variational calculation 

The fundamental theorem of calculus of variation defines the existence of a solution 
to the problem of integrals of functions minimization via the resolution of the Euler- 
Lagrange equation. 

Theorem 3.2 The Euler- Lagrange equation \2l^ : Let J : C 2 [£o,a?i] _ > be a func- 
tional of the form: 

J{y)= ! 1 f(x,y,y')dx (18) 

J x 
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where f has continuous partial derivatives of second order with respect to x, y and y', 
and Xq < X\. Let: 



S = {y e C 2 [x , xi] : y(x ) = y et y(xi) = y{\ (19) 
where yo and y\ are given real numbers. If y G S is an extremal for J, then 

d fdf\ df 



for all x G [xq, X\] 



dx \dy' J dy ^ 



The Euler-Lagrange equation, is thus a differential equation, generally nonlinear, 
that must be satisfied for any extremal function y(x). In other words, if y(x) is 
solution of the Euler-Lagrange equation, then the functional J, defined as the integral 
on [xo, xi] of a /, functional dependant on x, y and y', is minimal. 

3.3.3 Numerical resolution of the criterion L a 

Conjecture 3.1 Under certain conditions to define, the Euler-Lagrange equation, 



applied to the variational model-free Lagrangian (11), establishes the possibility of 



controlling the tracking error y — y* permanently by the on-line adjustment of a. 

The Euler-Lagrange equation thus allows to determine a such that the criterion 
L a is miminum. The continuous Euler-Lagrange reads: 

0L t , \ OL,, (21) 



dt V da' J da 



The integration of the variational model-free Lagrangian (16) provides the evo- 
lution law of a according to the time such that the integral of the error y — y* is 
minimal. 

Let us define the discrete Euler-Lagrange equation according to [28] [29] where 
Di and D 2 indicate the discrete derivation of the Lagrangian: 

D 2 L d (a k „ 1 , a k , h) + D 1 L d (a k , a k+1 , h) = (22) 

We have: 

K- p X rk ~dt +Ka —hT- \ + K- p \ lk dt +Ka ^~ i = ° (23) 

then: 

de 7fc+i - 27 fc + 7 fe _! 

^ k dt +Ka h* = ° (24) 
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The discrete symplectic integrator derived from (24) is written (expression of 7^+1 
according to and jk-i)' 



then: 



de 

hV ~d~t' lk + Ka ^ 7fc+1 _ 27fc + 7fc_1 ' 



h v de 
~Kldi 







2 7fc + 7fc-i = ~7fc+i 



(25) 



(26) 



Notice that the dependence with respect to the corrector K p does not exist any- 



more. Equation (10), called a control law forms with (16), the symplectic model-free 



control or i-PIS corrector (by extension of i-PI). 

Definition 3.4 When the system works in closed-loop, we define the intelligent con- 
troller that is symplectic type or i-PIS controller by: 



1 



u k = U k -l 



a 



fdy 




dy c 


\dt 


fc-1 


dt 



d7 
dt 



2 7fc - 7fc-i = 7fe+i 



h" de 
lQ~dl 

7o (resp. ceo) is initial condition 



(27) 



We preserved the natural notations of (10) (continuous into a) and (16) (discrete 
form in aQ. Let us note that a now seems a state variable of the model-free control. 



Remarks 



instability of the strong load transients When there are disturbances (vari- 
ations of model or load), the output may have to change quickly, this implies 
strong variations of the output derivative. However, under its conditions, al- 
though a Lipschitz condition is imposed on e, the assumptions requested to 
apply the Euler-Lagrange equation may not be satisfied. Simulations of the § 



3.5 show in particular that, if R is varying very slowly, then at each level of R, 
a oscillates then is stabilized; more R varies fast, more stabilization is slow. 



justification of the nature of (26) In order to interpret the form of the 



equation of the a control, which is of the damped harmonic oscillator type, 
let us look at the output buck converter signal in case of the i-PI (e.g. Fig. 
[5]). Those appear naturally oscillating and the role of the derivative in ^ is 
to attenuate these oscillations in order to reach the permanent state. It thus 



§The sign of the a derivative is not yet defined; this point belongs to the future studies in the 
symplectic model-free control. 
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appears rather intuitive that to counterbalance these oscillations, it would be 
enough to vary the coefficient a in the shape of an oscillator, which specifies 
well the law of a control. 

independence with respect to the initial condition on a the nature of 
the Euler-Lagrange equation implies a certain independence with respect to 
the initial conditions [^J This independence is in particular supposed to be 



true according to the simulations of the § |3.5[ We can also conjecture that 
independence with respect to the a initial means that a is auto-adjusted even 
if it undergoes strong variations. 

critical integration step h The integration step h seems a critical element 
and must be selected sufficiently small to allow the preservation of the condition 



of integration of the th. 3.1 



3.4 Symplecticity of the numerical integration methods 

Let us consider the damped mass system moving according to the x-coordinate for 
which we have the following Lagrangian: 

dx \ 1 / dx \ 2 1 
I ^) = 2 m U) + 2 fa2 (28) 



m and k are respectively the mass and the constant of the spring. Figures 4(a 



and 4(b) present respectively the traditional response of the system according to the 



time and the comparison of the energy of ( 28 ) calculated via the different integration 
methods. This example^] shows that the symplectic integration of Euler, correspond- 



ing to the equation of a control (26) is at the same time easy to implement and 



efficient regarding the preservation of the energy. 

3.5 Application of the symplectic model-free control 

Let us consider the buck converter for a slope output reference. Figure [5] presents the 
comparison between the i-PI and the i-PIS without impact of load; in all the cases, 
we took v — 1 and K a = 2. Let us note that the static error e tends to being slightly 
decreased in the case of the i-PIS, thanks to the "harmonic" compensation of the a 
coefficient. Figure M presents the case of the i-PIS corrector for two initial values of 



a for a progressive impact of loac ** of about 10 fl Let us note that the variations of 



^The effect of the initiaf conditions on the derivative of 7 is unknown. 

"From the work of Mr. Benjamin Stephens, Ph.D. student in the Robotics Institute at Carnegie 
Mellon University. 

**By respect of the Lipschitz condition on e. 
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2 5 1 1 1 1 1 1 1 1 1 1 1 

10 20 30 40 50 60 70 80 90 100 

time (s) 



(a) Speed and position of the mass according to the time. 




(b) Comparison of energy resulting from the various integration methods. 



Figure 4: Symplectic integration. 
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1 1 1 1 1 1 1 


— output voltage V 


1 1 1 1 1 1 1 


ref. output V 



0.001 0.002 0.003 0.004 0.005 0.006 0.007 0.008 0.009 0.01 

time (s) 




0.005 0.006 0.007 0.008 0.009 0.01 
time (s) 



0.001 0.002 0.003 0.004 0.005 0.006 0.007 0.008 0.009 0.01 

time (s) 

(a) i-PIS control for q?o = 3 



II 




— output voltage V 
ref. output V 

i 





0.001 0.002 0.003 0.004 0.005 0.006 0.007 0.008 0.009 0.01 

time (s) 




0.001 0.002 0.003 0.004 0.005 0.006 0.007 0.008 0.009 0.01 

time (s) 



(b) i-PI control for cuo = 3 

Figure 5: Comparison between i-PI and i-PIS without any load impact (R does not 
change) . 
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<1> 



<D 

° 2.995 
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~ 0.001 0.002 0.003 0.004 0.005 0.006 0.007 0.008 0.009 0.01 
g time (s) 



0.001 0.002 0.003 0.004 0.005 0.006 0.007 0.008 0.009 0.01 

time (s) 



(a) ao = 3 



o 
> 



"°0 

3-Q u 

m 
o 
> 
o 



o 
o 



a 10.05 



9.95 



— output voltage V 
ref. output V 



0.001 0.002 0.003 0.004 0.005 0.006 0.007 0.008 0.009 0.01 

time (s) 




0.001 0.002 0.003 0.004 0.005 0.006 0.007 0.008 0.009 0.01 

time (s) 



0.001 0.002 0.003 0.004 0.005 0.006 0.007 0.008 0.009 0.01 

time (s) 

(b) a = 10 



Figure 6: Comparison between two initial values of a: the load resistor increases 
gradually from R = 10Q at t = 0, 003 s such that R = ISfl at t = 0, 01 s. 
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a allow a priori only an adjustment of the i-PIS sensitivity since the initial condition 
on a appears as a median value around which a is adjusted. It is thus advisable to 
be able to choose properly the initial value of a. 

Compared to the i-PIS corrector, one will note the importance of the Lipschitz 
condition in the stabilization of this kind of transient. 

4 Towards a formalization of the model-free con- 
trol? 

We implemented a procedure of a auto- adjustment based on the calculus of variation 
and from the symplectic geometry considerations. The presented results are encour- 
aging but there remain much of challenges before arriving to a completely optimal 
i-PIS form. Future work should be directed towards formal proofs of stability and 
dynamic performances. 
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